AFRL-HE-WP-TP-2005-0016 


November  2005 

200701 03048 


AIR  FORCE  RESEARCH  LABORATORY 


: 


Enhancement  of  Stochastic  Resonance  by  Tuning 
System  Parameters  and  Adding  Noise 
Simultaneously 


Xingxing  Wu 
Zhong-Ping  Jiang 

Polytechnic  University 
Brooklyn,  NY  11201 


Daniel  Repperger 


Human  Effectiveness  Directorate 
Warfighter  Interface  Division 
Wright-Patterson  AFB  OH  45433-7022 


Approved  for  public  release; 
Distribution  is  unlimited. 


Human  Effectiveness  Directorate 
Warfighter  Interface  Division 
Collaborative  Interfaces  Branch 
Wright-Patterson  AFB  OH  45433 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and  maintaining  the 
data  needed,  and  completing  and  reviewing  this  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including  suggestions  for  reducing 
this  burden  to  Department  of  Defense,  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports  (0704-0188),  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington,  VA  22202- 
4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  any  penalty  for  failing  to  comply  with  a  collection  of  information  if  it  does  not  display  a  currently 
valid  OMB  control  number.  PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 

1 .  REPORT  DATE  (DD-MM-YYYY)  2.  REPORT  TYPE 

01112005  Conference  Proceeding 

3.  DATES  COVERED  (From  -  To) 

4.  TITLE  AND  SUBTITLE 

Enhancement  of  Stochastic  Resoncance  by  Tuning 

System  Parameters  and  Adding  Noise  Simultaneously 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

62202F 

6.  AUTHOR(S) 

*  Xingxing  Wu,  *  Zhong-Ping  Jiang,  **  Daniel  Repperger 

5d.  PROJECT  NUMBER 

2313 

5e.  TASK  NUMBER 

HC 

5f.  WORK  UNIT  NUMBER 

54 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

*  Polytechnic  University 

Brooklyn,  NY  11201 
**  Human  Effectiveness  Directorate 

8.  PERFORMING  ORGANIZATION  REPORT 
NUMBER 

9.  SPONSORING  /  MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

2Air  Force  Materiel  Command 

Air  Force  Research  Laboratory 

Human  Effectiveness  Directorate 

Warfighter  Readiness  Research  Division 

Collaborative  Interfaces  Branch 

Wright -Patterson  AFB  OH  45433-7022 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

AFRL/HECP 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

AFRL-HE-WP-TP-2  005 -  0016 

12.  DISTRIBUTION  /  AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  is  unlimited.  Cleared  by  AFRL/PA,  AFRL/WS-05-2634 
on  15  Nov  2005. 

13.  SUPPLEMENTARY  NOTES 

This  is  a  conference  proceeding. 

14.  ABSTRACT 

The  stochastic  resonance  effect  can  be  realized  by  tuning  system  parameters  or  by  adding  noise.  This  paper  investigates  the  possibility  to 
enhance  the  stochastic  resonance  effect  by  tuning  system  parameters  and  adding  noise  simultaneously.  First,  we  use  some  examples  to 
demonstrate  the  situation  where  only  the  system  parameters  or  noise  can  be  adjusted  for  maximizing  the  stochastic  resonance  effect.  Then, 
it  is  shown  using  standard  optimization  theory  that  the  normalized  power  normal  <C  >  of  the  bistable  double-well  system  with  a  periodic 
input  signal  can  reach  a  larger  maximal  value  by  tuning  the  system  parameter  and  adding  noise  simultaneously.  Finally,  for  the  purpose  of 
practical  implementation,  searching  for  the  optimal  system  parameter  and  noise  intensity  is  realized  by  an  on-line  fast-converging 
optimization  algorithm. 

15.  SUBJECT  TERMS 

Stochastic  resonance,  signal  processing,  optimization 

16.  SECURITY  CLASSIFICATION  OF: 

Unclassified/unlimited 


a.  REPORT 

UNCLASSIFIED 


b.  ABSTRACT 

UNCLASSIFIED 


c.  THIS  PAGE 

UNCLASSIFIED 


17.  LIMITATION 

OF  ABSTRACT 


SAR 


18.  NUMBER 

OF  PAGES 


Daniel  Repperger 


19b.  TELEPHONE  NUMBER  (include  area 
code) 


1 


Standard  Form  298  (Rev.  8-98) 
Prescribed  by  ANSI  Std.  239.18 


Enhancement  of  Stochastic  Resonance  by  Tuning  System 
Parameters  and  Adding  Noise  Simultaneously 

Xingxing  Wu,  Zhong-Ping  Jiang,  and  Daniel  W.  Repperger 


Abstract —  The  stochastic  resonance  effect  can  be  realized 
by  tuning  system  parameters  or  by  adding  noise.  This  paper 
investigates  the  possibility  to  enhance  the  stochastic 
resonance  effect  by  tuning  system  parameters  and  adding 
noise  simultaneously.  First,  we  use  some  examples  to 
demonstrate  the  situation  where  only  the  system  parameters 
or  noise  can  be  adjusted  for  maximizing  the  stochastic 
resonance  effect.  Then,  it  is  shown  using  standard 
optimization  theory  that  the  normalized  power  normal  <c,  > 

of  the  bistable  double-well  system  with  aperiodic  input  signal 
can  reach  a  larger  maximal  value  by  tuning  the  system 
parameter  and  adding  noise  simultaneously.  Finally,  for  the 
purpose  of  practical  implementation,  searching  for  the 
optimal  system  parameter  and  noise  intensity  is  realised  by 
an  on-line  fast-converging  optimization  algorithm. 

Index  Terms —  stochastic  resonance,  signal  processing,  and 
optimization. 

I.  INTRODUCTION 

Stochastic  resonance  (SR)  is  the  phenomenon  that  the 
noise  can  be  used  to  enhance  rather  than  hinder  the 
system  performance.  The  noise  can  excite  the  richness  of 
the  nonlinearities  and  provides  improved  dynamics  which 
better  enables  the  system  to  increase  signal-to-noise  ratio 
(SNR)  or  mutual  information.  The  concept  of  stochastic 
resonance  was  first  proposed  by  Benzi  in  1981,  addressing 
the  problem  of  the  periodically  recurrent  ice  ages  [1].  Over 
the  last  two  decades,  stochastic  resonance  has  been 
continuously  attracting  considerable  attention.  It  is  a 
ubiquitous  and  conspicuous  phenomenon.  Many  nonlinear 
systems  have  demonstrated  the  stochastic  resonance  effects, 
such  as  discrete  systems  [4],  dynamic  systems  [2],  static 
systems  [5],  coupled  systems  [6]  and  random  systems  [7]. 
The  signal  can  be  periodic  [2],  aperiodic  [8],  subthreshold 
[2]  or  suprathreshold  [9].  In  order  to  quantify  the  stochastic 
resonance  phenomena  and  reveal  the  synchronization 
between  signals  and  noise,  different  measures  have  been 
adopted.  For  the  periodic  signals,  the  most  commonly  used 
quantifier  is  signal-to-noise  ratio  (SNR)  [2].  For  aperiodic 
signals,  cross-correlation  measures  [10],  power  norm  [8] 
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and  information-based  measures,  such  as  mutual 
information  [11],  are  used  instead.  Over  the  years, 
stochastic  resonance  has  been  applied  in  wide-range  of 
areas,  such  as  physics,  chemistry,  biomedical  sciences,  and 
engineering  [2-3].  One  of  the  important  applications  of 
stochastic  resonance  is  in  signal  processing.  As  a  nonlinear 
signal  processor,  it  has  been  used  for  signal  detection  [12- 
13],  signal  transmission  [14-15]  and  signal  estimation  [16]. 
In  order  to  realize  the  stochastic  resonance  so  as  to  make 
the  chosen  quantifier,  e.g.  the  output  signal-to-noise  ratio 
(SNR),  reach  its  maximal  value,  certain  conditions  must  be 
satisfied.  The  traditional  way  is  to  adjust  the  noise  intensity 
by  adding  optimal  amount  of  noise.  Recently,  tuning  system 
parameters  have  been  demonstrated  to  be  a  better  method  to 
realize  stochastic  resonance,  especially  when  the  initial 
input  noise  level  already  exceeds  the  resonance  region  [17- 
19].  The  output  SNR  will  reach  a  higher  maximal  value  by 
tuning  system  parameters  than  by  adjusting  noise  intensity 
[18].  Among  this  research,  either  the  noise  intensity  is 
adjusted  or  the  system  parameters  are  tuned  in  order  to 
maximize  the  chosen  measure,  but  not  both.  This  paper  will 
investigate  the  possibility  to  further  increase  the  maximum 
by  tuning  the  system  parameters  and  by  adding  noise 
simultaneously.  This  will  in  turn  improve  the  system 
performance  when  used  as  the  nonlinear  signal  processor 
for  signal  detection,  signal  transmission  or  signal 
estimation. 

The  rest  of  this  paper  is  organized  as  follows.  In  Section 
2,  we  demonstrate  the  cases  when  only  system  parameters 
or  noise  intensity  can  be  adjusted.  Section  3  will  prove  the 
possibility  to  further  increase  the  maximal  value  of 
normalized  power  norm  [8]  of  the  aperiodic  stochastic 
resonance  in  bistable  double-well  system  by  adjusting 
system  parameters  and  noise  intensity,  based  on  the 
conventional  first-order  necessary  condition  and  second- 
order  sufficient  condition  in  optimization  theory.  Section  4 
will  provide  an  on-line  fast-convergent  optimization 
algorithm  to  search  the  optimal  system  parameters  and 
noise  intensity.  Section  5  is  devoted  to  verify,  via  computer 
simulations,  the  improvement  of  maximal  <c,>  by 
comparing  the  maximal  normalized  power  norm  obtained 
by  tuning  system  parameters,  by  adding  noise  and  by  both. 
Finally,  Section  6  closes  the  paper  with  brief  concluding 
remarks. 


II.  STOCHASTIC  RESONANCE  VIA  TUNING  SYSTEM 
PARAMETERS  OR  ADDING  NOISE 


In  some  stochastic  resonance  systems,  the  chosen 
measures  can  be  described  as  a  function  of  both  the  system 
parameters  and  the  noise.  This,  however,  does  not  ensure 
that  both  system  parameters  and  noise  can  be  adjusted  at  the 
same  time  to  maximize  or  minimize  these  quantifiers.  In 
[20],  the  output  signal-to-noise  ratio  is  affected  by  the  ratio 
of  noise  variance  and  system  parameter  (threshold),  rather 
than  by  the  parameter  value  and  noise  individually.  The 
paper  [17]  shows  that  the  noise  intensity  cannot  be  adjusted 
and  must  be  fixed  at  the  initial  value  (no  noise  will  be 
added)  in  order  to  minimize  the  bit  error  rate  (BER)  for  the 
aperiodic  stochastic  resonance  (ASR).  In  this  case,  only 
system  parameters  tuning  is  meaningful.  In  what  follows  we 
will  demonstrate  this  is  also  true  for  the  periodic  stochastic 
resonance  in  double-well  bistable  dynamic  systems. 

The  double-well  bistable  system  is  described  by  the 
equation  [21]: 

T/x(t)  =  x(t)-^  +  s(t)+Tj(t)’  (1) 


where  system  parameters  Ta  >  0,  Xb  >  0.  The  periodic  input 
is  s(t)  =  Acos(27H /Ts) .  T)(t )  is  an  additive  Gaussian  white 


noise  with  zero  mean  average  and  autocorrelation  of 
<7j(t)rj(0)>=2DS(t)- 

For  small  and  slow  input  signal,  the  output  signal-to- 
noise  ratio  is  given  by  [21]: 

SNR-J ’  <2> 

(£>/r„)J  D/t / 


Assuming  parameter  T a  is  fixed,  the  output  SNR  is  a 

function  of  both  system  parameter  Xb  and  noise  intensity  D. 
One  constraint  on  the  noise  intensity  is  that  it  should  not  be 
less  than  the  initial  value  D0.  There  are  also  constraints  on 
the  parameter  X b .  For  example,  xb  >  yfri A  /  2  for  the 
subthreshold  system  [17]. 

To  prove  our  above  claim,  assume  the  SNR  is  maximized 
at  the  optimal  values  ( X[yD *)•  Obviously,  there  will  be  a 

local  maximizer  for  this  optimization  problem  if  both 
system  parameter  Xb  and  noise  intensity  D  can  be  adjusted 
at  the  same  time.  According  to  the  first-order  necessary 
condition  for  a  local  maximizer,  we  have  VSNR(Xb,D)  =  0 > 

and  thus: 

Xl  =  %D,Xl  =  4D  ,  (3) 

The  derived  solution  (Xb  =  0  and  D  =  0)  does  not  meet 
the  constraint  requirements.  In  other  words,  this 
constrained  optimization  problem  has  no  local  maximizer. 
This  means  either  system  parameter  Xb  or  noise  D,  but  not 
both,  can  be  adjusted  to  maximize  the  output  SNR. 

In  order  to  determine  which  one  will  take  the  extremum 
and  which  one  is  not  adjustable,  we  can  rescale  the 
variables  as: 


X  =  t/Ts,  y  =  xjTJD,  X„=XhJrjD, 

A  =  AjfjD,  7a=x JTS-  (4) 


For  the  rescaled  y-system,  its  noise  density  becomes  unit 
and  the  output  SNR  is: 

_  V.  (5) 


[—  A  Xb  /  4  X, 
SNR  =  V2  _  exp(- 


(l/O2 


1 1*. 


Y 


Now,  the  optimization  parameters  are  A  and  xb  • 

Obviously,  A  should  take  the  maximal  value  in  order  to 
maximize  SNR.  From  (4),  this  means  that  the  noise 
intensity  should  be  fixed  to  its  initial  value  D0  which  is  also 
the  minimal  noise  intensity,  assuming  the  signal  amplitude 
A  is  not  changeable.  Again,  only  system  parameter  Xb  can 
be  adjusted. 

In  the  next  section,  we  will  examine  some  interesting 
situations  where  both  the  system  parameters  and  noise 
intensity  can  be  adjusted  simultaneously  to  improve  the 
stochastic  resonance  effect. 


III.  STOCHASTICRESONANCEENHANCEMENT 


In  [22],  the  aperiodic  stochastic  resonance  (ASR)  was 
demonstrated  in  the  bistable-well  system.  The  cross- 
correlation  measures  (power  norm  C0  and  normalized 
power  norm  Ci)  were  adopted  for  characterizing  the  ASR 
behaviour: 

C0  =  max  {S  (t)R(t  +  r)} 


r  = _ _  Cq  _  (6) 

[52(/)],/2p(0-R(0]2},/2 

where  S(t)  is  the  zero-mean  aperiodic  input  signal,  R(t)  is 
the  mean  transition  rate  of  the  system. 

The  symmetric  bistable-well  system  with  a  fluctuating 
barrier  is  given  by  [22]: 


dx 

dt 


dU  r,  x 

"  aT  ^(  )f 


(7) 


where  {/(*) =-[,<-$(/)]_+£_ 
2  4 


is  the  potential  function. 


Usually,  A  is  a  constant.  Here  A  will  be  taken  as  a  system 
parameter.  £(*)  is  Gaussian  white  noise  with  zero  mean 
average  and  autocorrelation  of  <  £(/)£( s )  >=  2 DS(t-s)  •  The 
angular  brackets  denote  an  ensemble  average. 

In  general,  the  power  norm  does  not  have  an  explicit 
expression.  For  the  specific  case  where  the  signal  amplitude 
is  small  compared  with  the  barrier  height,  i.e.,  s(t)2  «A2> 
and  S(t)  is  a  Gaussian-distributed  signal,  <Co>  and  <C|> 
are  given  as  [22]: 

<C0>*  0Aexp[-e  +  A2S\Y)/2]S\t)y  (8) 

.  r .  flsW*  (9) 

(exp[  A*  $’(<)]  - 1  +  a(D)Q-’  exp[20  -  A1  S!(/)]),,J 


where  ff(D)  =  K,<  R(l)  > . <  R(<)  >=  £?exp[-0 +A;52(/)/2] 
Q  =  k0A/j2x,Q  =  A3  /4D, A  =  A !2D 


We  will  choose  <Ci>  as  the  objective  function  to  be 
maximized.  The  theoretic  expression  of  <Cj>  can  predict  its 
real  shape,  even  when  the  noise  intensity  is  outside  the 
range  of  its  validity  [22].  So,  we  can  form  the  following 
constrained  optimization  problem: 

max  <  C,  >,  ,  (10) 

subject  to  S(t )2  «  A2,  D  >  D0 
The  optimization  parameters  are  the  system  parameter  A 
and  the  noise  intensity  D.  From  the  expressions  of  0,  0 

and  A  ,  we  notice  that  0  is  a  function  of  Q  and  A  : 

0=^e=ceA.  (JO 

2*o 

where  c=^7i/2^  is  a  constant,  Q  and  A  are  functions  of  A 
and  D. 

The  <Cj>  can  be  expressed  in  term  of  Q  and  A  : 

<c  >=_ _ Ai _  ,  (12) 

1  {exp[AV]  -1  +k{Q  1  exp[cA£?  +  */A2]},/2 


where  5=[^(,)],/2  and  d=S2(t)/2-S2(t)=-s-. 

Therefore  we  will  be  interested  in  maximizing  <Q>  at 


some  nonzero  optimal  values  Q*  and  A* . 

From  the  simulation,  we  find  that  there  is  a  unique  local 
maximizer  for  the  unconstrained  optimization  problem,  i.e. 
(10)  without  the  constraints.  Unfortunately,  the  local 


maximizer  ( Q*  and  A* )  cannot  meet  the  constraint 
requirements  for  some  input  signal.  For  example,  when 
s=0.01,  we  will  have  A*  =142.791,  Q' =0.0032,  A*=0.014. 
It  cannot  meet  the  requirement  of  small  signal  (s(t)2  «  a2)- 
So  we  introduce  two  additional  parameters  (a>0,  b>0) 
into  the  system  by  defining: 

(13) 


x2  x 4 

U(x)  =  -{A-S(0]—  +  — 

2  a  4b 


We  can  then  get: 

<  C.  > 


s  A 


(14) 


(exp[s2A2]  - 1  +  kxQ  1  exp[caAQ  +  dA2])l/1 
where:  q  =  k0A/ fla n ,0  =  bA 2  /4a2D,A  =  bA/2a2D,G  =  caAQ  • 


From  (14),  one  sees  that  the  bigger  the  parameter  a ,  the 
smaller  the  <C,>  will  be.  Here  parameter  a  will  be  taken  as 
a  supporting  parameter  used  to  adjust  the  local  maximizer 
(Q\  A*)  to  enable  A*  and  D*  to  meet  the  constraints. 
Parameter  b  is  also  taken  as  a  supporting  parameter  which 
will  be  used  to  match  parameter  a  to  keep  the  potential 
function  in  good  shape  and  make  the  optimal  noise  intensity 
D*  reasonable.  For  example,  we  can  let  b/  (2a2)  be  a  proper 
constant. 


Proof:  First,  it  is  shown  that  the  first-order  necessary 
condition  has  at  least  one  solution: 

From  the  first-order  necessary  condition: 


B<c  ,> 
3A 


=  0  and 


3<C,  > 
BQ 


=  0. 


(15) 


We  get: 
caAQ  =  1, 

(2  -  2j  2  A2 )  exp[j 2  A2  ]  -  2 


(16) 


+  k, (2 Q-'  - caA - 2dA2Q~' ) exp[caQA  +  </A2]  =  0 


Letting  Q  ]  =  ca  A ,  we  have 
(2-2i2A2)exp[i2A2]-2 
+caA:l(A-2c/A,)exp[l+<M2]  =  0 


(17) 


Let  /(A)  denote  the  left  hand  of  equation  (17). 
Obviously,  f  (0)  =  0  and  f  (+  00 )  =  - 00  •  Also: 

=  (-4i2A  -  4,y2  A1 )  exp[.v:  A2  ] 

^  (IS) 

+&,ctf(l  + 2s2A2  -s4A4)exp[l  +  ^A2] 


If  A  — >  0+ ,  we  get  $f>0  -  We  can  conclude  that  there  is 
3A 

at  least  one  A  >  0  satisfying  eq.  (17). 

Now,  we  need  to  prove  that  the  solution  is  unique  for 
fixed  parameters  a  and  b. 

Let (A)  =  (2 - 2^ZA2 ) exp[^2A2 ] .  The  function  /,( A)  will 
decrease  monotonically  to  —  °o  as  A  — >  oo>  starting  from 
f  (0)  =  2 .  We  denote  the  rest  part  of  the  LHS  of  equation 
(17)  as  function  /2(A)  =  ca/:,A(l  +  52A2)exp[l-^2A2  / 2] •  It 
will  first  increases  from  zero,  and  then  decreases  to  zero. 
From  these  special  characteristics  of  /j( a)  and  /2(A),  it 
follows  readily  that  equation  (17)  can  only  have  one  positive 
solution. 

Proposition  2:  The  parameter  a  can  be  used  to  continuously 
adjust  the  values  of  Q'  and  A*  satisfying  the  first-order 
necessary  condition  of  the  unconstrained  optimization 
problem  to  ensure  A*  and  D*  will  meet  the  constraint 
requirements. 

Proof:  From  (17)  and  definitions  of  y^A)  and  f2( A),  we 
notice  that  parameter  a  only  affects  f2( A),  but  not  /((A) 
which  is  a  decreasing  function  of  A .  The  increase  of 
parameter  a  will  increase  the  value  of/2(A)  for  the  same 

A.  This  will  in  turn  increase  A* .  Also,  A*  will  approach 
zero  when  parameter  a  approaches  zero.  This  means  that 

A*  can  be  changed  continuously  by  adjusting  parameter  a. 


Proposition  1:  There  exists  one  and  only  one  pair  of 
parameters  (Q\  A*)  satisfying  the  first-order  necessary 
condition  of  this  unconstrained  optimization  problem. 


Proposition  3:  There  is  one  and  only  one  local  maximizer 
for  the  unconstrained  optimization  problem  with  small 
input  (s«l)  and  properly  chosen  parameters  a  and  b. 


Proof :  Assume  the  pair  (Q\  A*)  is  the  only  solution 

satisfying  the  first-order  necessary  condition.  We  need  to 
prove  the  pair  will  also  satisfy  the  sufficient  condition  of  the 
unconstrained  optimization  problem,  that  is,  the  Hessian 
matrix  y2  <c,  >(a \q')  is  negative  definite. 

At  the  point  ( Q* ,  A* ),  we  have:  1 


2(-s3 A*2 )[sA*  exp[ s1  A*2 ]  +  kxca{- -  +  S  ^  )]cxp[l  - s2 A*2  / 2] 
_ 2  4 _ 

(exp[52  A*2  ]  - 1  +  k&'-'  exp[l  +  of  A*2  ])3/2 

d2  <  C{  >  _ (-^cV^A*4) _  (20) 

dQ'2  ~  2(exp[j2A*2  ]  - 1  +  k{Q*~l  exp[l  +  dA*2  ])3/2  ’ 

32  <  C,  >  _  d2  <  C,  >  _ 

aA*ag*  =  ag*a  a*  ,  (21) 

(-£,c2a2.yA*2)  exp[l  +  dA*2  ] 

2(exp(V A*2  ]  - 1  +  k{ Q*~‘  exp[l  +  dA*2  ])3/2 

We  have:  (for  s«l) 

2j2A*2  exp[^2A*2] 

+  2ktcasA*(-l  /  2  +  s2A'2  /  4)  exp[l  -j2A*2  /  2] 

=  2exp[s2A*2]-2 

+  k{caAk[(\  - s)  +  s 2 A*2 (1  +  s  /  2)]  exp[  1  -  s2 A*2  /  2] 

=  2j2A*2  exp[.s2A*2]  >  0 

So  <C,  >  forg*.  A* ,  and  small  input  signal  (s«l). 
dA  2 

If  the  parameter  a  is  adjusted  properly  such  that 
s(A*)2»l,  the  numerator  of  the  Hessian  matrix 
determinant  value  is: 

2expjVA‘2]-2 

+  /r,ca(A*  — +  s2 A*1)  exp[l  -  s2 A*2  /  2] 

^A 

«  2exp[52A*2]-2 
+  ^,ca(A*  +  ^2A*3)exp[l  -s2£2 12] 

=  2^ 2  A*2  exp[s2A*2  ]  >  0 

From  the  standard  test  on  negative-definiteness  of  a 
symmetric  matrix,  it  follows  that  the  Hessian  matrix  is 
negative  definite.  This  completes  the  proof  of  Proposition  3. 

Proposition  4\  There  is  one  and  only  one  local  maximizer 
for  the  original  constrained  optimization  problem  (10)  with 
small  input  and  properly  chosen  parameter  a  and  b. 

Proof:  From  above,  we  can  get  A*=2/  A* .  In  order  to  satisfy 
the  constraint:  (A*)2  »s2,  we  should  have  s2(A*)2«4. 

Combined  with  the  requirement  s(A*)2»l,  we  should 
have:  ^  «j2(A‘)2  «4  for  small  input  signal  (s«l).  This 
can  be  satisfied  by  adjusting  parameter  a.  Also,  D*  will  be 
greater  than  D0  for  the  properly  chosen  parameter  b. 


Therefore,  Proposition  4  follows  directly  from  Proposition 
3. 

Proposition  5:  The  local  maximizer  (A*,  D*)  is  also  the 
global  maximizer  of  the  constrained  optimization  problem 
(10). 

Proof  It  follows  from  Proposition  4  and  the  fact  that  the 
first-order  necessary  condition  only  has  one  solution. 

From  the  above  analysis,  the  normalized  power  norm 
<C1>  of  the  double- well  bistable  system  with  Gaussian- 
distribution  input  signal  can  be  maximized  by  tuning 
system  parameter  A  and  adding  noise  simultaneously  and 
will  reach  a  higher  maximal  value  than  that  of  adjusting 
only  the  system  parameter  or  noise  intensity. 

IV.  OPTIMIZATION  ALGORITHM 

There  is  no  closed-form  solution  for  the  constrained 
optimization  problem  in  Section  3.  The  maximizer  can  be 
obtained  by  solving  the  nonlinear  equation  (17)  with  the  aid 
of  standard  optimization  algorithms.  In  some  situations, 
however,  this  optimization  problem  should  be  solved  on¬ 
line  with  changing  input  signals,  such  as  the  case  of  high¬ 
speed  target  detection  when  it  is  used  as  the  nonlinear 
signal  processor.  The  speed  is  a  critical  requirement  in 
these  situations.  This  makes  the  development  of  an  on-line 
fast  convergent  optimization  algorithm  an  issue  of  crucial 
importance. 

Let  /(A)  be  the  left  part  of  equation  (17).  Noting  that 
V/(A*)  is  nonsingular  for  small  input  signals,  the  following 
result  can  be  proved  using  standard  arguments  from  [23]: 

Proposition  6:  The  Newton’s  Method  for  Nonlinear 
Equations,  when  applied  to  solving  /(A* )  =  0 ,  gives  a 

local  Q-quadratic  convergence,  if  A0  is  sufficiently  close  to 

A* . 

Our  proposed  optimization  algorithm  is  based  on  the 
Newton  Algorithm.  The  optimization  algorithm  is  divided 
into  two  categories.  The  fist  case  is  when  parameters  a  and 
b  are  fixed.  They  are  properly  chosen  so  that  the  pair  of 
optimal  solutions  (A*,  D*)  for  the  unconstrained 

optimization  problem  can  meet  the  given  constraints.  The 
second  case  is  when  parameter  a  should  also  be  adjusted  on¬ 
line.  Here  we  assume  parameter  b  is  a  pre-defined  function 
of  parameter  a.  For  example,  b/(2a2)  =  const. 

Case  1: 

The  convergence  speed  of  the  Newton  algorithm  depends 
on  the  initial  value  A0.  We  propose  a  way  to  estimate  the 

initial  value  for  different  input  signals  on-line,  based  on  a 


table  or  function  constructed  off-line.  The  table  or  the 
function  describes  the  relationship  between  input  signal 

average  amplitude  s  and  the  optimal  value  A*  which  can  be 

got  off-line.  For  a  gi\en  input  signal  s,  A*  will  first  be 
estimated  using  interpolation  for  the  table  or  direct 
calculation  for  the  function  constructed  off-line.  This 

A*  will  then  be  used  as  the  initial  value  A0  for  this  input 

signal.  It  will  be  close  to  the  optimal  value  to  ensure  the 
required  convergence  ;peed,  if  the  table  or  the  function  is 
constructed  properly. 

Algorithm  1: 

Step  1: 

Calculate  its  average  amplitude  value  s  =s*(f)  for 
the  given  input  signal; 

Step  2: 

Estimate  initial  A0,  using  the  constructed  table  or 

function; 

Step  3: 

Solve  /(A* )  =  0  using  normal  Newton  Algorithm 

[23]; 

Step4: 

Calculate  Q*,  and  D*  and  stop. 

Case  2: 

If  adjustable,  the  smallest  parameter  a  ensuring  the 
satisfaction  of  constra  nts  will  maximize  <Ci>. 

Similarly  we  can  rely  on  the  off-line  work  to  increase  the 
convergence  of  the  cn-line  algorithm.  Two  tables  or  two 
functions  will  be  coistructed  off-line.  The  first  table  or 
function  describes  the  relationship  of  A  *  with  input  s  and 
parameter  a.  The  second  table  or  function  is  the  relationship 
of  input  signal  s  with  a*,  where  a*  is  the  smallest  parameter 
a  for  the  above-statid  constrained  optimization  problem 
with  input  signal  s. 

Algorithm  2: 

Step  1: 

Calculate  s=sfj),  set  x0  =  0,y0  =  -f°° 

Step  2: 

Estimate  a*,  ake  it  as  the  initial  value  ao; 

Step  3:  Estimate  the  initial  value  A0 ; 

Step  4: 

Solve  /(A* '  =0  using  normal  Newton  Algorithm 

[23]; 

Step  5: 

Ifs«s2( A*)  • 

1  =  ak * x  *+i  ~  xk>  ak+ 1  =  (xk+ 1  +  1 V  2 

else: 


=yk,xk+i  =ak 

if  =+o°: 

=  2a, 

else: 

ak+ 1  =(**+i  iV2 

Step  6: 

V \aM~ai  M: 

Calculate  Q*,  A*  and  D*  and  stop. 

else : 

Go  back  to  Step  3 
V.  SIMULATION  RESULTS 

In  order  to  verify  the  improvement  of  the  maximal  value 
of  normalized  power  norm  <Q>  by  adjusting  system 
parameter  A  and  noise  intensity  D  simultaneously  over  that 
by  adjusting  system  parameter  A  or  noise  intensity  D  alone, 
simulation  is  performed.  The  following  is  the  simulation 
result:  (Ko=l,  Ki=0.019,  a=0.001,  and  A=1  when  adjusting 
D,  and  D=0. 1  when  adjusting  A) 


Fig.  1.  Comparison  of  Maximal  <Ci> 


V.  CONCLUSION 

This  paper  demonstrates  the  possibility  to  further 
enhance  the  stochastic  resonance  effect  if  the  system 
parameter  and  the  noise  intensity  can  be  adjusted  at  the 
same  time.  The  enhancement  of  the  stochastic  resonance 
effect  will  in  turn  improve  the  system  performance  and  have 
wide  application  in  signal  and  image  related  engineering 
problems  such  as  target  detection.  Specifically,  the 
nonlinear  signal  processor  based  on  stochastic  resonance 
will  increase  the  target  detection  performance  if  it  has  a 
higher  output  signal-to-noise  ratio. 
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